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ABSTRACT 

A democratic model of educational evaluation and some 
policy recommendations to develop culturally appropriate evaluation 
are presented. The traditional hard science paradigm in research must 
be replaced with evaluation designed to feed back lo communities of 
varying cultural backgrounds. The most fundamental assumption of the 
new model is democracy, or the democratic principle, meaning 
participation by people in decisions that affect them. The 
value-aesthetic focus is to identify shared and cherished ideas from 
multiple cultures. The shared value system of a multicultural 
democracy will be operational ized into new forms of educational 
evaluation through participatory design development that involvej 
representation of each participating culture in the selection of 
evaluation methodology. Culture must be incorporated into the 
discourse categories of evaluation to make evaluation a contributing 
part of the democratic process of education. The bottom line for the 
new model of evaluation is not the use of usual descriptive 
information gathered from standardized and normed instruments; 
rather, the intent is to prescript ively reinform the participants of 
their own perceptions of their children's school environment, 
instruction, and the values transmitted. One figure presents the 
evaluation model. (SLD) 
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Introduction 

We need a future in which "people" can find parity, a chance for the unrepresented 
majority of minorities to be heard and given a chance to participate in any decisions tha 
S them Nothing to date has established the avenues or strategies, methods or 
designs to develop culturally appropriate evaluation procedures. 

We can proceed as we have in the past and legislate what has come to be known 
as the "hard" science or educational psychology paradigm as the method for multicultura 
studies. Or. we can accept the challenge to seek out new ways to explore educational 
"successes" within various cultural contexts. 

The challenge remains for those with technical and humanistic expertise to fin^^ 
way to collect and collate cultural material in a design that gives parents and multicultural 
participants the dignity and even prestige of contributing to their own futures. 

As educators, we speak of human rights and human dignity, democratic 
participation in those judgments that affect us and the quality of life we project for 
ourselves and our children. Yet, as we deal with fellow citizens of America s multicultural 
communities, the families and their children, we as researchers and/or evaluators usually 
presume too much. We pursue our own agendas and neglect the needs and desires ot 
the people for whom our efforts should be intended. The negative impact of such 
humanistic oversights, social amnesia on "intercultural" understanding is illustrated in the 
following reaction by Native Americans to standard research and publication activities: 

Just as the exploitation of American Indian land and 
resources is of value to corporate America, research and 
publishing on American Indian topics is valuable to non-Indian 
scholars. As a result of racism, greed, and distorted 
perceptions of native realities, Indian culture as an econornic 
commodity has been exploited by the dominant society with 
considerable damage to Indian people. Tribal people need 
to safeguard the borders of their cultural domains against 
research and publishing incursions. 



Community based research in Indian communities needs to 
be conducted in conjunction with the endorsement by tribal 
authorities for the purpose of ensuring that the finished 
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product has value to Indian people and is educationally 
beneficial. 

Scholarly research on Indian history and culture must take 
into account Indian perspectives. ...This methodology win 
heto scholars avoid perpetuating stereotypes of Indians based 
on mythology, misconceptions, and romanticism. American 
Indian scholars need to become involved in producing 
research rather than sen/ing as subjects and consumers of 
research. Measures such as these will ultimately introduce 
more accurate depictions of Indian experiences and lifestyles 
into the classroom. (Our Voices. Our Vision: American 
Indians Speak Out for Edn f-atinn Excellence, pp. 6-7) 

As this Native American perspective illustrates, culturally diverse communities 
families ar^dthSfcNIdren do not characteristically have the academic^ 
interpret and critically review the agendas imposed upon them. Worse than that, there 
Is Srievabte^^^^ in which we make significant efforts to find out what these parents 
want for their children. 

We do not seek ways to integrate the parents' perceptions of the'^ children in 
school with our expectations for these students as learners. We pay ^^^^^^^S^'^ 
cultural values and totems in the construction of our school curriculum for their children. 

The cherished values of the culture are rarely translated nor incorporated, reviewed 
nor exhibited as prime ingredients of the regular classroom or school curriculum. How 
can we approach these communities? Would any amount of sincerity be anything less 
than ludicrous, even if we went "hat-in-hand" to parents to assure them of our benevolent 
intentions and our sensitivity to their needs and cherished ideals. 

We use standardized or "pseudo" scientific data collection devices to evaluate 
student "success" in school and pretend that feeding this data back to parents and 
communities provides them with some kind of meaningful information about their children. 
This usually confounds parents' understanding of their children's school experience and 
further alienates kids and parents from schools, or at best demeans the parents 
participation. 

Each research instrument we use to examine and collect parents' perceptions 
does little more than constrain the discretionary range of their answers. 

t^y purpose with this presentation is to suggest more democratic, culturally 
appropriate parameters for evaluating and incorporating parental input into their children's 
educational futures. We must disabuse ourselves of the traditional hard science 
paradigm in research and formulate a more democratic collection and collation of 
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formation designed to ,eed-baoK ^o^'^'^^^J:^^ ^o??h~;T;r. 
,0 continue to co-opt their pnmaof^ arts to information with ne» 

maintain an integrity in data '"^f'°P'JZt,rnm73rJna cultural backgrounds. The 
considerations as to the implications ,'° '^rntes f om ^^^^^ 1^ ^^i^^ 

advantage of this kind of °rS^£v pS^^^ ^""^ '^^^'^ 

rpo?!aniro?S!ll"-^^^^^^ 

conflict 0. Traaitiona. Evaluation -Paradigm,- and Participants' Perceptions 

some might respond that -puaiK^ive" ^^^^^^^^^ 

paradigm. First, it would as a catch-ali descriptor 

avoid the rampant popular tendency to use tM^^^^^^ ^^^^ ^ ^ase of 

for methods which are "°V''"!^S to' refer to rvariety of social science research 
unnecessary vagueness "hen used to *° ^^^^^"^ other ethnomethodoiogical 
methods including ethnographic, c^e ^^, and s ,he term 

XSS?^ormrd^e.g. aTrc^^hlc or a case study. 

Funhermore.thesesocialscienceresearchpara^^^^^^^^^^ 
of incorporating the value-aesthetic^apres^ 

ro^ Tis t;ory?S~ rrpl^e tUlon ,rom description .0 

prescription. 

some desired educational end. 

Multicultural Educational Evaluation: A Democratic Model 

The choice of this democratic model is a prescriptive approach to mode! t^sigru 
Thp m^derser^es as a prescriptive design, an informing hypotheses. It is 
SmpJ^henUe'Tnd each category applies at each level in parallel form. 
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Figure A: A Democratic Model: Multicultural Educational Evaluation 
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Valuc^Aesthetlc: 

The most fundamental assumption of this model is demoora^ ^rtdSo 'of 
principle. Morris Bigge asked me °"^^"et am dfcLo^ ^ oh a^^^^^ 

|L rufeV"rrof t ^d l ScesTch group involved to conthb^e to education 
andTducatonarevaluation as part of a larger, broader human nghts system. 

The most promising value-aesthetic focus cross-cufturaliy 1^° itflli"^ 'susar; 
Her third "philosophy" of ^^^t involveme^^^^^^ 

emphasizes success for allchildren in a ^ i3 

as a fundamental component 

upon all participants. 

A caveat to the democratic shared value system is -^at e^^^^^^^^^ 

^irm=i ^^c^^^- -^^^^^^^^ 

Td Sill LSate in shared ^ setting with the broader society? Perhaps each culture 
woulSl^^^^^^^^^^^ Of values Snging from Pn-t^^^^^^^^^^^ ^^^l 
one hand, to the public, sharable and democratic on the other. Such sharing will oe 
necessary if we are to avoid a Rrave New World. 



Methodology 

The shared value system of a multicultural democracy will be °f nationalized into 
new forms of educational evaluation through participatory design ^eveloprnent. Exte^^^^^ 
evaluations developed by a power eirte in the dominant culture cannot be 'mposed upon 
comr^unity members if that society claims to be a democracy and education is to be a 
part of that process. 

Some materials produced for U.S. Federal program evaluation presents evaluators 
as quintessential ethnocentrics. The only mention of any "cultural" considerations ,n two 
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federal evaluation publications is a data analysis Illustration demonstrating how to rep ^rt 
ethnicity for participants. (Hawkins. J. and B. Nederhood. 1987; Ralph. J. & M.C. Dwyer. 
1988) 

Reoresentatives of each participating culture, or culturally sensitive evaluators. 
shouldSor be invol^^ in the development of appropriate methods and instruments^ 
f ev^fuation spe^^^ not available from each culture, cultural consu tants could 

Lrk witrorofSonal evaluators. This would require a new breed of evaluation 
roeciarst eduS^ for reconstructing methods and instruments toward 

sCcomS goals Culturally appropriate evaluation methods and instruments w.y 
nnf Ti^t be tVans^^^^ of dominant culture evaluations into the native language. The 
method of evalTS^^ vs. independent, should also match preferred cultural 

interaction styles. 

There mav be no easily identifiable cultural taxonomies upon which to base 
evaluaton meThodSogy for many current cultures. The impact of western or global 

of marw Native American cultures are already half a century old. Ethnoscientific 
(Lrte7anri9l4) studies of 21st centurv cultures will contribute to development of 
culturally appropriate methodologies. 



Culture 

Culture must be incorporated into evaluation's discourse categories if evaluation 
is to become a contributing part of the democratic process of education. The three-leve 
definition of culture used In this model (Figure A) provides a comprehensive definition of 
the concept. 

Arthropology shares with other social sciences the Methodenstreit of the 19th 
century concern for meanings established on cooperative terms with those being studied. 
The Emic perspective should be considered, for it reflects the world view of each culture 
in its own terms. Etic categories, traditional categories of anthropology, provide cultural 
description in more uniform ways. 

There is a view of culture beyond anthropology's descriptive science. Culture as 
a value-aesthetic completes this comprehensive definition. "Culture is a qualitative format, 
an aesthetic form, which sen/es to regulate a wide range of personal, social activity in the 
life of some determinate group - indeed, it constitutes the group as such." (Villemain. 
1976. p. 44). 
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Some Policy Recommendations 

Participants, parents, students, teachers, in a democratic evaluation process should use 
their language of choice when providing input. 

T»,e perceptions, criteria for worth, of those affected by the educational process should 
be incorporated into the evaluation goals. 

agency nor to the dominant educational research, evaluation elite. 

Ethnoscientific studies establish cultural taxonomies for education goals, which should be 
incorporated into the evaluation categories. 

The methods and instruments of the evaluation should be developed by or In conjuncticn 
with those participating In the educational process. 

The design of the evaluation, its goals, methods. Instruments, should be formulated in 
IHd ?un analogically parallel to the group processes being evaluated. 

Results of educational evaluation, which are 9«"«^- W"^^^^ 
inotPimpntq soecificallv standardized test scores, should not be putilisnea as r^ogdnvtj 
;Snf in mot cor^r^uni*^ involved. There should be a community privacy of 
information code. 

qharflri and cherished ideals for a group should be used to identify the enlightened self 
fnte rest pro^^^^^ education. Modifications and corrective measures 

shouW alw^^^^^ established within the cultural framework of those being evaluated. 

Evaluations, which open options and contribute to shared futures for multiple cultures, set 
parameters for "new" educational evaluation/research paradigms. 



Summary 

Again, the purpose of this type of research/evaluation should be to re-educate the 
participants in the process and not to reach "conclusions" derived from statf ca 
machinations of data collected by inappropriate instruments, or in the ^Jf^f^^fl 
anthropological method, "objectively" to describe the dichotomies of Native and Western 
school cultures. The bottom line for this type or evaluation is not the use of usual 
descriptive information gained from such standardized, normed. instruments, father the 
Intent is to prescriptively reinform the participants of their own perceptions of their 
children's school environment, instruction, and values transmitted. This reflexive use ot 
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meir own information empowers P-en^^ and .he co— by encouraging .hem ,o 
partidpate knowledgaably in the schooling of their chiidren. 

The exciting possibilities for -^one invoK,ed evaiu^^^^^^ P^^'. -^^^^ 

is to turn the evaluation process W°J ^ directly back to 

Educational evaluaton should 'become a part o, the dem^o^^^^^^^ no' 
merely as an end, but as an integral composition of means methods encs. 
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